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MAKE-UP COUNSELING APPARATUS 

TECHNICAL FIELD 

The present invention relates to a make-up 
5 counseling apparatus, and more particularly, to a 

make-up counseling apparatus designed to be used for 
counseling make-up for a subject by acquiring a 
facial image of the subject. 

10 BACKGROUND ART 

When providing counseling on make-up, in 
order to select colors of lipstick and other 
* m cosmetics that match that person's skin color, it is 

y-4 necessary to have an accurate understanding of skin 

if? 15 color. 

m 



rii 



In Japanese Laid-Open Patent Application No. 
10-174733, the present applicant has proposed a 
system for providing make-up counseling by measuring 
and classifying the color of the skin of a person's 
20 face and acquiring a facial image. In this system, 
a strobe and digital camera, as well as a halogen 
lamp for spectral measurements, are provided inside 
a measurement unit. The measurement unit is then 
positioned at a predetermined distance from a chair 
25 in which the subject sits. A half mirror is 

provided at the front of the measurement unit, and 
the subject's posture is then adjusted so that the 
center of the face aligns with a reference line 
inscribed on the half mirror and indicating the 
30 photographic center. The skin color is measured by 
analyzing the reflected light with a spectrometer at 
the same time as other processes are carried out as 
well . 

The conventional measurement unit is an 
35 elaborate affair, having a half mirror on the front 
and containing a strobe and camera as well as a 
halogen lamp and a spectrometer. The large scale 
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and the cost: of such apparatuses were drawbacks. 

In reducing the scale of the system, it 
might appear that the halogen lamp and the 
spectrometer can be eliminated and skin color 
measurement obtained easily from the facial image as 
photographed by the digital camera. However, the 
luminance and the color of the facial image changes 
due to the effects of external light from the 
environment in which the system is located, and 
moreover, fluctuations in the distance from the 
digital camera, to the subject causes the luminance 
of the facial image to change, resulting in the 
problem that the skin color cannot be measured 
accurately, that is, without being affected by the 
environment . 

DISCLOSURE OF THE TNVRMTTOAT 

It is a general object of the present 
invention to provide an improved and useful make-up 
counseling apparatus that solves the above-descr ibed 
problems of the conventional art. 

A more specific object of the present 
invention is to provide a make-up counseling 
apparatus that is small in scale and simple in 
structure, and suitable for a counselor to provide 
counseling on make-up to a subject. 

Another object of the present invention is 
to provide a make-up counseling apparatus that is 
small in scale and simple in structure, and further, 
that can objectively and accurately measure the 
brightness and skin color of a subject's face. 

In order to achieve these objects, the 
present invention comprises a computer positioned at 
a basal portion of an apparatus for conducting image 
processing and counseling processing; a first image 
display means for displaying a computer-processed 
image to a subject, mounted upright in the computer; 
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a second image display means for displaying the 
computer-processed image to a counselor, mounted 
upright in the computer so that a display screen 
thereof is directed in a direction opposite the 
first display means; and photographic means, 
positioned near the first image display means, for 
photographing a subject directed in a direction of 
the first display means and feeding a facial image 
of the subject into the computer. 

According to such a make-up counseling 
apparatus, because a first and second image display 
means are provided upright on a computer and a 
photographic means is provided nearby, the scale of 
the apparatus can be reduced and its structure can 
be simplified. 

In order to achieve these objects, the 
present invention further comprises a make-up 
counseling apparatus comprising a digital camera for 
photographing a subject; a strobe for illuminating 
the subject; a distance sensor for measuring a 
distance to the subject; color balance adjustment 
means for adjusting a color balance of the digital 
camera so that a difference in color between color 
values of a color sample image of predetermined 
colors obtained from a color correction chart having 
a plurality of color samples placed at approximately 
equal distances illuminated by the strobe light and 
photographed by the digital camera, and color values 
of color samples of the predetermined colors 
measured under previously predetermined conditions 
is within a stipulated range of values; conversion 
formula calculation means for obtaining a conversion 
formula for converting the color values of the color 
sample image obtained from photographing the color 
correction chart with the digital camera into Lab 
values of the color samples measured under 
previously predetermined conditions; deviation 
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calculation means for obtaining a deviation between 
the color values of the color sample image obtained 
from photographing the color correction chart with 
the digital camera converted into Lab values using 
5 the conversion formula and the Lab values of color 
samples of the predetermined color measured under 
previously predetermined conditions; brightness 
correction means for correcting the brightness of a 
facial image according to a distance measured by the 

10 distance sensor when the facial image of a subject 

at approximately a fixed distance is photographed by 
the digital camera as a photographic object; and 
color correction means for correcting the 
brightness-corrected facial image according to the 

15 deviation. 

According to such a make-up counseling 
apparatus, by adjusting the color balance of the 
digital camera using the color correction chart, 
obtaining a conversion equation for converting the 

20 image photographed with the digital camera into Lab 
values, obtaining a deviation thereof with respect 
to a reference of an image photographed using the 
digital camera, correcting a brightness of the 
facial image of the subject according to the 

25 distance measured by the distance sensor, and 

further correcting the color of the facial image by 
the aforementioned deviation, the brightness and 
skin color of the face of the subject can be 
measured accurately without being affected by the 

30 environment using a simple composition of the 

digital camera, the strobe and the distance sensor. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects, features and advantages of 
35 the present invention will become more apparent from 
the following detailed description and the 
accompanying drawings . 
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FIG. 1 is a plan view of one embodiment of 
the make-up counseling apparatus of the present 
invention . 

FIG. 2 is a front view of one embodiment of 
the make-up counseling apparatus of the present 
invention . 

FIG. 3 is a side view of one embodiment of 
the make-up counseling apparatus of the present 
invention . 

FIG. 4 is a block diagram of one embodiment 
of the make-up counseling apparatus of the present 
invention . 

FIG. 5 is a diagram showing the make-up 
counseling apparatus of the present invention in use. 

FIG. 6 is a diagram showing one embodiment 
of a color correction chart 75. 

FIG- 7 is a main flow chart of one 
embodiment of processes executed by the apparatus of 
the present invention. 

BEST EMBODIMENT FOR PRACTICING THE INVENTION 

A description is given below of an 
embodiment of the present invention, based on the 
drawings . 

FIG. 1, FIG. 2 and FIG. 3 show plan, front 
and side views of the make-up counseling apparatus 
of the present invention. In FIGS. 1-3, the make-up 
counseling apparatus comprises a photographic unit 
10, a personal computer 20, a liquid crystal display 
(LCD) monitor 30 with a touch panel for use by a 
subject, and a LCD monitor 40 with a touch panel for 
use by a counselor. 

The personal computer 20 is positioned at 
the bottom of a base of the apparatus, and as shown 
in FIG . 3 the LCD monitors 30 and 40 are positioned 
upright along two parallel sides of the personal 
computer 20 so that their rear surfaces are disposed 
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opposite each other and inclined so that their upper 
edges contact each other. Acrylic trapezoidal side 
panel members 50, 52 are positioned upright along 
both left and right edges as shown in FIG. 1. These 
5 side panel members 50 f 52 are fixedly mounted on the 
personal computer 20 and the LCD monitors 30 and 40, 
respectively, forming a storage space for the 
photographic unit 10. 

The photographic unit 10 comprises an 
{rtS L. 10 acrylic face member 11 that is U-shaped in cross- 

|3 section, a digital camera 12, a strobe 13 and a 

= ! ff distance sensor 14, each fixedly mounted. A lens 

ijft" 12a of the digital camera 12 projects from the face 

member 11, with through-holes provided on the face 

Lfl 

^ 15 member 11 for positioning light from the strobe 13 

and for positioning input/output of ultrasound {or 

V". electromagnetic) waves from the distance sensor 14, 

ill 

respectively. 

The photographic unit 10 is installed by 
H 20 left and right edges 11a, lib of the face member 11 

with the U-shaped cross-section being guided by the 
side panel members 50, 52 so as to slide freely in 
the direction of arrows Al , A2 as shown in FIG. 3, 
and in the state shown in FIG. 3 retaining parts of 

25 the face member 11 which are not shown in the 
drawing engage the side panel members 50, 52. 
Similarly, when the lens 12a is retracted into the 
camera 12 and stored and the above-described 
engagement is released, the photographic unit 10 

30 becomes slidable. The photographic unit 10 can then 
be slid in the direction of arrow A2 and stored in 
the above-described storage space. 

The LCD monitor 30 with a touch panel for 
use by the subject is configured so that a 

35 transparent touch panel 32 is adhered atop the 

entire surface of a LCD unit 31. The LCD monitor 40 
with a touch panel for use by a counselor is 
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similarly configured, with a transparent touch panel 
42 adhered atop the entire surface of a LCD unit 41. 
It should be noted that the respective LCD units 31, 
41 of the LCD monitors 30, 40 are disposed so as to 
5 face in opposite directions. 

FIG. 4 is a block diagram of one embodiment 
of the make-up counseling apparatus of the present 
invention. In the diagram, in the personal computer 
20 a central processing unit (CPU) 21 is connected 
Y*k , 10 to a RAM 23, a ROM 24, a hard disk drive (HDD) 25 

3 and a CD-R (compact disk-recordable) device 26, 

£T respectively, via a bus 22. Additionally, the 

435 digital camera 12, strobe 13 and distance sensor 14 

'^l of the photographic unit 10 as well as the LCD units 

||l 15 31, 41 and transparent touch panels 32, 42 of the 

LCD monitors 30, 40 are connected via an I/O 
} .T interface (I/O) . It should be noted that it is 

!«£ permissible to use a storage medium such as a floppy 

' V J disk, CD-RW or MO and the like in place of the CD-R. 

•j^T 2 0 The CPU 21 executes a variety of processing 

programs stored in the ROM 24 or the hard disk 25, 
and proceeds with processing in response to input 
from the transparent touch panels 32, 42. 
Additionally, processing results are written to the 
25 CD-RW device 26 and at the same time displayed by 
the LCD units 31, 41, respectively. 

FIG. 5 is a diagram showing the make-up 
counseling apparatus of the present invention in use. 
In the diagram, a make-up counseling apparatus 60 is 
30 placed on top of a desk. The subject sits in a 

chair 80 with her back toward a background screen 70, 
directly facing the photographic unit 10 of the 
make-up counseling apparatus 60. In this state the 
subject's face is photographed by the digital camera 
35 12. The subject then talks with the counselor 
across the make-up counseling apparatus 60. 

When correcting the photographic unit 10, a 
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color correction chart 75 is provided at a position 
at which the face is photographed on the background 
screen 70 facing the digital camera 12 as shown in 
FIG. 6. On the color correction chart 75 are 
5 printed a variety of color samples , from reddish 
skin color to standard skin color, yellowish skin 
color, blackish-red skin color, blackish skin color, 
blackish yellow skin color, red, green blue, whitish 
red skin color, whitish skin color, whitish yellow 
10 skin color, black, color number N3 . 5 , color number 
>h N5 , color number N6.5, color number N8 and white. 

■i;3 It should be noted that the color numbers N3 . 5 , N5 , 

N6.5 and N8 are respectively N3 . 5 , N5, N6 . 5 and N8 
K| grays on the lightness scale of the Munsell value 

[II 15 function. 

'if*- 

FIG. 7 is a main flow chart of one 

■y- 

W embodiment of processes executed by the apparatus of 

the present invention. First, as a preprocessing 
) lft j for acquiring a facial image, in a step S10 the 

O 20 strobe 13 is fired, the color correction chart 75 of 

the background screen 70 is photographed by the 
digital camera 12, and in a step S12 the color value 
of the color sample of each and every color inside 
the color correction image (the average value of a 

25 plurality of picture elements) is obtained. Next, 
in a step S14, a color difference between the color 
value of the standard skin color of the color 
correction chart image and the color value of the 
standard skin color previously stored in the hard 

30 disk drive 25 is obtained- In a step S16 it is 

determined whether or not the color difference is 
within prescribed values and, if outside those 
limits, then in a step S18 the color balance of the 
digital camera 12 is adjusted so as to minimize the 

35 above color difference. The process then proceeds 
to the step S10, where steps S10-S18 are repeated. 

If in step S16 it is determined that the 
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above-described color difference is within 
prescribed limits, then the process proceeds to a 
step S20, where the respective color values R r G, B 
of the gray chip black, color number N3 . 5 , color 
5 number N5 , color number N6.5, color number N8 and 
white within the color correction chart image 
undergo linear conversion to obtain the red TRC , 
green TRC and blue TRC tone curves of the luminance 
corresponding to red, green and blue. Next, in a 
M 10 step S22, red TRC (R) , green TRC (G) and blue TRC (B) , 

which are values obtained by linear conversion of 
color values R, G, and B for each of reddish skin 
color, standard skin color and yellowish skin color 
izl within the color correction chart image with the 

if! 15 tone curves red TRC(R), green TRC (G) and blue TRC (B) , 

J 1 \ and the CIE (Commission Internationale de 

1'Eclairage) 3 stimulus values XYZ of the reddish 
H skin color, standard skin color and yellowish skin 

color previously stored in the hard disk drive 25, 
W= 2 0 are substituted into formula (1) below and 

individual conversion matrix elements rXc , rYc, rZc, 
gXc, gYc, gZc, bXc, bYc, bZc are obtained. 



O 

33 



(Formula 1) 



25 



Next, in a step S24, using the formula (1) 
that used the obtained conversion matrix, the 
reddish skin color, standard skin color and 
yellowish skin color within the color correction 

30 chart are each converted to CIE 3 stimulus values 

XYZ , and the respective CIE 3 stimulus values XYZ of 
the reddish skin color, standard skin color and 
yellowish skin color are converted to Lab values 
using a formula (2) . It should be noted that the 

35 Lab values are a color space expressed as metric 
lightness (L) , metric hue angle (a) and metric 
chroma (b) . 
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a - 17.5(1.02X-Y)/VF 
b - 7.0 (Y-0.84Z) / VF 
l = 10VF , 0 < Y < 100 

•••(2) 

Next, in a step S25 , the color correction 
chart 75 is once more photographed with the digital 
camera 12, the L»,a,b values obtained for each of the 
reddish skin color, standard skin color and 
yellowish skin color within the color correction 
chart image and the deviation thereof from the 
respective L,a,b values for the reddish skin color, 
standard skin color and yellowish skin color 
measured by the spectrometer and previously stored 
in the hard disk drive 25 is stored in the hard disk 
drive 25. 

Thereafter, in a step S26, the strobe 13 
fires and the face of the subject sitting in the 
chair 80 with the background screen 70 as a 
background is photographed with the digital camera 
12. Virtually simultaneously, in a step S28 the 
distance to the subject's face is measured by the 
distance sensor 14. 

Next, in a step S30 , the luminance of the 
facial image of the subject is revised in picture 
element units, based on the measured distance. If 
the distance measured by the distance sensor 14 is 
Dl with respect to a given reference photograph 
distance D and a luminance correction factor k = 
(Dl/D)2 is obtained and the CIE 3 stimulus values of 
the facial image of the subject are XI, Yl , Zl, then 
the CIE 3 stimulus values X, Y Z of the facial image 
at the reference photograph distance D are obtained 
according to formula (3) . 



L 698 179673 



-11- 



x - k x xi 

Y - k x Yl 

Z - k x zi . . . (3) 

5 

Thereafter, in a step S32 , the facial image 
is color corrected using the deviation obtained 
previously in the step S24. Thereafter, in a step 
S34, various counseling processes are conducted 

10 using the corrected facial image to determine skin 

color distribution over the entire face, determine a 
facial look, carry out simulations involving 
different lipstick, eye shadow, eye liner, rouge, 
hairstyles and so forth, thereby providing make-up 

15 counseling to the subject. 

Thereafter, in a step S36, it is determined 
whether or not to continue with the processing. If 
continued, then the process proceeds to a step S26 
and repeats steps S26-S36. If not continued, then 

20 the process is terminated. 

As described above, LCD monitors 30, 40 are 
supplied upright on a personal computer 20 and a 
photographic unit 10 is positioned nearby, so the 
scale of the apparatus can be reduced and its 

25 structure simplified. Additionally, the space 
formed by the personal computer 20 and the LCD 
monitors 30, 40 is used as container space for the 
photographic unit 10, thus making it possible to 
make the apparatus even more compact, and in 

30 particular, improving the portability of the 

apparatus. Additionally, the use of LCD monitors 30, 
40 with touch panels makes an input apparatus such 
as a keyboard unnecessary, making it possible to 
make the make-up counseling apparatus even more 

35 compact. 

Additionally, because the photographic unit 
10 has the digital camera 12 for taking photographs 
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of the subject, the strobe 13 for illuminating the 
subject and the distance sensor 14 for measuring a 
distance to the subject, luminance correction of the 
image of the subject photographed can be corrected 
5 based on the distance to the subject. 

Additionally, by adjusting the color 
balance of the digital camera 12 using the color 
correction chart 75, obtaining a conversion equation 
for converting the image photographed with the 

10 digital camera 12 into Lab values, obtaining a 

deviation thereof with respect to a reference of an 
image photographed using the digital camera, 
correcting a brightness of the facial image of the 
subject according to the distance measured by the 

15 distance sensor 14, and further correcting the color 
of the facial image by the aforementioned deviation, 
the brightness and skin color of the face of the 
subject can be measured accurately without being 
affected by the environment using a simple 

20 composition of the digital camera 12, the strobe 13 
and the distance sensor 14. 

Moreover, as shown in the use embodiment in 
FIG. 5, the respective LCD units 31, 41 of the LCD 
monitors 30, 40 are disposed so as to face in 

25 opposite directions, so the counselor can dispense 
counseling by facing the subject directly while the 
subject looks at the LCD unit 31 and the counselor 
looks at the LCD unit 41. At this time, the 
contents of the display displayed by the LCD unit 31 

30 and the contents of the display displayed by the LCD 
unit 41 may be the same. However, for the LCD unit 
41 comments for counseling use may be added to the 
.display contents of the LCD unit 31, or the contents 
of the two displays may be completely different. 

35 it should be noted that the photographic 

unit 10 corresponds to the photographic means of the 
claims, the LCD monitor 30 with a touch panel for 
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use by a subject corresponds to the first image 
display means, the LCD monitor 40 with a touch panel 
for use by a counselor corresponds to the second 
image display means, steps S1-0S18 correspond to the 
color balance adjustment means, steps S20-S22 
correspond to the conversion formula calculation 
means, steps S24 and S25 correspond to the deviation 
calculation means, step S30 corresponds to the 
brightness correction means and step S32 corresponds 
to the color correction means. 



